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ABSTRACT 

the first Niagara County Comprehensive Plan subaitted 
to the New York Sta^e Division fcr Youth in 1977 articulated as its ' 
first priority a youth service delivery system- The , attainment of 
this objective involved the simultaneous* development of a . * 

self-e valuation procedure? which could be used. as a basis for 
decision making. Thirteen social service agencies and administrative 
groups participated in the evaluation project which is. described in 
this report. The involvement of each participating group in their 
respective social service activities is. detailed in tabular form. It 
is indicated that^the evaluation process was well received and that, 
*in teems of agency performance in the delivery of youth services, all 
groups scored at. or better than the expected level. Appended to the 
report are a copy of the evaluation planning guide, various 
information forms distributed to the participating agencies, and a 
list of comments and reactions (related to the evaluation) by agency 
staff members. (Author/GO 
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ABSTRACT- 



During the development/pilot year of the Niagara County 
Evaluation Planning Project conducted by JnD Research 
13 participating groups (4 administrative, 8 direct service, 
and 1 functioning in both capacities) developed a total 

t - 

, of 95 Goal Attainment Scales. 

Results of an assessment of the evaluation indicated that 
the process and the evaluation team were extremely well 
received. 



AH groups scored at or better than the expecte/i level 
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INTRODUCTION 

< 

i 

The first Niagara County Comprehensive Plan submitted to the New York State Division 
for Youth in December, 1 977 articulated as its major objective and first priority the 
development of a youth service delivery system designed to meet the needs of all Niagara 
County Youth. "Instrumental in the achievement of this objective was the development 
of an evaluation mechanism which could be Used as a basis for cogent decision making. 
Resultingly, JnD Research was requested to plan and develop over a multi-year period 
a comprehensive evaluation system to be used to assess services and functions within the 
Youth Service System including the processes incorporated in the comprehensive plan itself. 

The evaluation design submitted to NiagaralCounty by JnD Research contains two major 
components. These are: x 

1 . the evaluation of those units which provide direct service to youth such as 

(a) ' Youth Bureaus, direct service functions; ' 

(b) Youth Service Projects; 

(c) Community Agency; and 

(d) Recreational Services; and 

2. the evaluation of those units which comprise the management level of the Youth 
Service System; that is, those units which are responsible for management functions 
such as planning, coordinating, and monitoring. Included in this component are: 

(a) Youth Bureaus, with the exception of their direct service function; 

(b) Youth Boards, and . K 

(c) Administrative Committees associated with Comprehensive Youth 

Services Plahning. 

Jhe strategy, called goal attainment scaling, used with both of the above components 
allows for maximum program and project input in a facilitative, non-threateniftg climate. 
Incorporating a compliance model, the system is structured arouncphe degree to which 
predefined objectives are being attained (formative or process evaluation) and the degree 
to which these objectives have been attained (summative or product/impact evaluation). 
The system has a special appeal because ail of the evaluation- tasks are performed mutually 
by the evaluators and the specific group partif ipating in the evaluation process. The system, 
therefore, provides for a highly individualized evaluation while simultaneously establishing a 
base for systematic, standardized comparison: 



■ * 

■ ♦ 

More specifically, the procedure operates as follows: 

At the beginning of the project year, a setpf objectives for a particular task area is 
generated by relevant'staff and the evaluates. An instrument is then developed which 
ranks attainment of these objectives along alive level continuum. The expected level (0) 
is the middle level of that continuum. Attainment of this level is both realistic and possible 
as perceived by the group. The remaining levels of the continuum are much less than 
expected (-2), less than expected £-1), more than expected (+1), and much more than 
expected (+2). J 

The number of scales developed is dependent on the number of objectives selected for 
evaluation since separate objectives or f undtions within a task area form separate scores 
on the instrument. Onoi the scales have been developed, they are weighted to indicate 
relative importance. , 

Scales are defined using both narrative and quantitative statements. The selection of task 

areas, the delimitation of objectives, and the scale definitions are mutually determined by 

the ©valuators and program personnel. Scale completion is also undertaken mutually. In 

this way, the evaluation is as muchSelf evaluation as it is an outside evaluation. 

* 

In addition to the process evaluation afforded by goal attainment scaling, enumerative 
evaluation is also utilized since the quantitative^ statements within the scale definitions and 
the scale weights contribute to a numerical score for the scale. By summing across scales, a 
score for an entire instrument is also obtained. sr 

The finalized, mutually agreed upon instrument is administered several times during the 
course of the project year when appropriate to provide process feedback and at the final 
meeting to ascertain a measurement of impact. 

In general, at the conclusion of the development and implementation period, the 
establishment of this evaluation system should enable funders and funded projects to 
function more effectively and will enable funders to ascertain funding priorities based on 
sound, systematic results. 

* JnD Research was funded by the City of North Tonawanda for "the first planning, 
development, and pilot year of this project. The remainder of this document presents the 
final project report for that first year of funding. 
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Pinal project report 

♦ 

4 

JnD Research was funded for the current year on July 1 , 1978. and completed the 
contract within a six month period. The major requirement was the development of^~ 
a series of evaluation planning guides with a selected group of agencies and adminis- 

0 

trative units. 



DEFINITIONS - 1 

7 

Evaluation Planning Guide {see Appendix A) 
This guide serves as the basis for the Niagara County Comprehensive Planning Evaluation 

* • * 

Project and utilizes a 5-scale format. Each scale on the guide consists of 5 vertical cells, or 

levels, headed by a descriptor. Entitled "Function", this descriptor states the general area 

of administration or service and identifies that specific aspect which the particular scale is 

. intended to measure. 

Each scale contains 5 measurement levels. These are: w 

much less than expected: value of 2 i 

less than expected: value of -1 

expected (is most likely 

to happen; can be realis- value of 0 

tically attained) ' 

„ more than expected value of +1 . ^ 

much more than expected value of +J 

Each scale also contains an "indicator" located in the middle cell (or expected level). This 
"indicator" is the operationalized variable or way in which the specific aspect of administration 
or service will be measured. I 

A "weight", placed at the top of each scale, is that number which has been assigned to the 
scale to reflect the relative importance of that scale to all other scales written by an- agency or 
an administrative unit. 



Scale Type: 

singular - One scale in the group of * multiple Two or more scales in the group 
vertical cells of vertical cells, (referred to as a 

set of subscales) 



Measurement: 

singular scales multiple scales 

simple frequency simple frequency 

simple percent. simple percent 

comparitive percent -with in ceil cumulative frequency 

e.g. 95-105% of October cumulative percent 
attendance > * 



Review Possibilities: 

singular scales 

at the end of the project year 

at the end of theactivity (total - 
Le. encompassing entire activity) 

at the end of the activity (predeter- 
mined interval i.e., en compassing 
part of the activity) 



multiple scales 

at the end of the project year k 

at the end of the activity (total 

for clarity this date is underlined on each guide) 



at the end of the (activity (predeter- 
mined interval) 

« 

at the end of each subscale in the set 



Preview Possibilities: 

angular scales 

at the beginning of the projectiyear 

at the time of mutual agreement 

at the start of the activity (if this 
occurs after the start of the project 
year) 

no preview (logically unnecessary 
e.g. scale is a research' study) 



multiple scales * 

, at the beginning of the project year 

• at the time of mutual agreement 

at the start of the activity (if this 
occures after the start of the project 
year) 

at the start of the 1 st subscale in the set 
at the start of each subscale in the set 
no preview 

Note: In instances where no behavior has as yet' 
occurred at the time of preview (e.g. no newsletters 
printed yet, no significant requests for aid) the no 
frequency category or lowest cell f-2) is assumed. 



' Scopes: 



x i 



the score for a level or cell on the^gtfiele (+2 to -i) 



w, the scale weight 

Rj the review score for a scale 
• Rj = XjW| 

Pj the preview score for a scale 
p. = x-W- 

C: the change score for a scale 



<V=R«- p i 



GRAND REVIEW One review scorff for an agency or administrative unit. Includes all scales 
for that agency or unit. 
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The Grand Review score can be calculated using the goal attainment scale score- formula 
developed by .Dr. T. J. Kiresuk and Dr. Robert Sherman. This score typically has a mean 
of 50, a standard deviation of 10, and a theoretical range of 0 to 10. The formula is 
presented below: 



G.A.S. 



50 + 



n 

10 £ WjXj 
i=1 



i=1 



n n 0 

(1-P>£w: 2 + P(Cwj) 2 



i=1 



where 
*i 



w i 



n 



the score on the ith scale of the evaluation planning guide 
the relative weight of the ith scale 

a weighted average intercorrelation of the scales or the 
expected overall intercorrelation among goal scores. 
This value must be assumed. 

the number of scales on the evaluation planning guides 
constructed by an agency or administrative group. 



r 

A simpler formula developed by JnD Research can be used to give a quick visual indication 
of overall placement o^he 5 level continuum. Since this, is not as rigorous as the above 
formula, the summary statistic provided by the Kiresuk-Sherman formula is to be preferred. 
The JnD. formula is presented below: 

. / * . 



Visual Indicator (V.I.) 




\ 



< I 



where 

-the numerator is the score achieved, 

the denominator is the highest score possible, and 

m 

yj is the highest level completed for a given scale 



Product Evaluation: v 



' For this pilot year, review scores will be established for all scales and GRAND REVIEWS 
calculated for each agency or unit. 



Process Evaluation: 

in addition io the feedback provided during the design period by the design process- 
itself, change scores will be utilized as part of a process evaluation. 
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METH^POLOGY 



Sample * * 



- An initial planning meeting with the Steering Committee of the Niagara County Compr- 
ehensive Plan determined that sixteen groups would be contacted and asked to participate 
in the evaluation process; ten direct service agencies and six administrative units. The specific 

> 

groups to be contacted were selected at that meeting. These were: 

Direct Service Agencies Administrative Units * 

North Tonawanda Youth Bureau ' North Ybnawanda Youth Board 

Alternative Learning Center Niagara County Youth Board 

Project CARE NiSgara County Youth Bureau 

Kenan Center Rural Committee 

Center for Young Parents Evaluation Committee 

Lewiston Recreation Commission Program Committee 

Mid City Coordination Commission 
Child Maltreatment Project 

Green Circle * » 

Big Brother/Big Sister 

The direct service agencies were invited to attend a presentation in Lock port. At that 
meeting, JnD Research presented an overview of the process and invited the agencies to _ 
participate. Nine agencies attended |hat meeting and all nine agreed to participate. The 
handout distributed at that meeting is presented in Appendix B. 

Telephone follow-up to arrange dates for a first meeting with the nine participating 
agencies were made by JnD Research staff. The decision to omit the tenth agency (Mid 
City Coordination Commission) was made by^Tiembers of the Steering Committee. One 
agency (Green Circle) participated for half of the process but terminated for the present 

0 * 

year due to an internal administrative change. 

The administrative units were also contacted by telephone. Initial contact was made by 
the Steering Committee with a follow-up call from JnD Research staff to set up dates for 

* * * 

♦' meeting. Two units agreed to participate at the request of the Steering Committee. (Niagara 
County Youth Bureau and the Evaluation Committee). A presentation by JnD Research 
was made to the two Youth Boards and the Program Committee of the Niagara County 
Youth Board. As a result of that presentation, the North Tonawanda Youth Board and 
the Program Committee of the Niagara County Youth Board agreed to participate. The 
Steering Committee made the decision to omit the Rural Committee for the present year. , 

6 

Ultimately, thirteen groups agreed to participate with one group (Project CARE) 
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functioning in two capacities. That is, Project CARE agreed to construct scales for its 
direct service functions as well as its administrative functions. t 

Figure 1 which follows presents the sample for this first year, jfclsb presented are the 

m • • * 

rtotal number of different people from each group who were involved in the 



.Groups , 

Direct Service Agencies. 

North Tonawanda Youth Bureau 
Alternative Learning Center 
Project CARE ' 
% r Kenan Center 
. Gerry for Young Parents 
Lewtston* Recreation Commission 
Child Maltreatment Project 
Green Circle 

Big Brother/Big Sister , 



Administrative Units 

North Tonawanda Youth Board 
Niagara County Youth BureJu 
Evaluation Committee 



Program Committee 



Project CARE 



TOTAL 



tiot of Different Participants 



"S" 



2 (entire staff) 
3 

>3 
5 

3 plus 3 who observepVOnce 
1 (entire staff ) 

2 



2b pros 



6 



3 = 28 



9 plus 3 who observed once 
5- plus 1 who attended once 
4 

3 as above-eliminated from.grand total 
27 plus 4 - 31 

49 plus 7 observers -56 • * 



Figure 1. The Sample. 




Procedure * I 

In order to complete the procedure each qtpup participated in four tovsix meetings. Tlfe , . 
initial meetings tfhree to five) were used to introduce the process, to elicit functions, and to 
design scales. The last meeting was used to evaluate the attainment of objectives, functions 
or services outlined on the scales. Session forms were completed for each meeting by the 
"jnD Research staff member who led the group. -Copies of these forms are presented in • 
Appendix C. Also included are session forms for .the meetmtfflth the Steering Gommittee 
and the presentation in Lock port. 

The first meeting was used to familiarize the participating group with the goal attainment 
scaling process. To accomplish this an overview of the process was presented which was ' 
generally completed in not more than one hour. Fop those groups which had participated 
in an introductory presentation theiamilia^ization was shortened accordingly. The over- 
view was purposely kept brief because an understanding of the theory becomes relatively 
dear.only after a group begins to take an active role in generating their own scales. Typically 
< the overview contained a presentation of the history of goal attainment scaling, a definition of 
pertinent terms] and a description of how the use of this method could benef it the group. 

With the completion of the more.fprmal part of the meeting, the group was asked to taRe a 
more active role. This was accomplished in two ways. First, the agency or administrative unit 
briefed the evaluation team dn its functions and services. Second, group members were asked 
to list the groups functions and/or specific areas of services. Depending on the size of the 
group and the type of functions involved, each group member may have listed functions or 
♦services independently. When all members had made some type of list, the lists 'were shared. 
A new fist was then made utilizing the.input from each group member. If the group was small, 
the first step (independent listing) was omitted. Generating and categorizing the fist of functions 
into task areas usually required all of the time remaining in this f irst meeting. 

During the second meeting, the list of functions or task areas were reviewed and revised. 
When the group agreed that the task areas were workable, the process of selecting indicators 
began. That isf operational objectives (specific measureable objectives) were generated for 
selected task areas. In some cases it was possible to devise indicators for ail selected areas 
during this second meeting. The third meeting was then spent completing the design of the 
scales. Weighting was also accomplished at this time. -Some groups, however, needed more 
. time to delineate functions and design 7 scales and subsequent meetings were planned and 

H 

♦ f 

scheduled accordingly. 

Regardless of the humber of meetings required to complete the initial phase of the process, 

1 t 



consultation related to planning and management was provided by the evaluation team*. 
-This was included generally upon request and was especially important to make sure each 
group member knew what data was necessary for the evaluation, how to go about collecting 
ft, and what his particular responsibility was. Because h provided help in organizational 

*i ' . .a' 

skills, it aided the. group function as a working unit committed to the evaluation process 
while also, hopefully helping the group to provide its service in a more effective manner. 

Scale review was conducted at the fourth or final meeting. Data was presented to 
substantiate the level reached for each scale a$d a preliminary score calculated for all scales. 
The last meeting was also used to evaluate the evaluation process itself. Bef or e-t he scales 
were rated, each participant was asked to complete a questionnaire entitled "Reactions" 
(see Appendix D). Response to this questionnaire was voluntary and anonymous. ^ 

in addition to management consultation, planning aid was also provided to some groups 
by establishing scales which contained process review dates. That is, objectives were oper- 
ationalized on a quarterly or semi -yearly basis as welt as on a yearly or end of project basis. 

Figure 2 (page 12) summarizes the procedure section by presenting the number of 
meetings held with each participating group and the number of scales developed. 

It should be noted that JnD Research was funded for the current year on July 1 , 1977. 

As a result, the procedure originally designed to,operate over a full year period was con- 

« 

denied into a half year. Optimally, objectives and their accompanying scales should be 
established at the beginning of the projectyjBar. Since this was not the case, some change 
was necessitated in the focus of the evaluation for the present year. That is, each group 
' had to backtrack, In a sense role play b'y pretending that the scales were being designed as 
of test January. For those groups whose services and functions were clearly delineated, 
this was not a problem. For others, the delay resulted in some confusion. Therefore, it ts 
strongly recommended that in future funding years, every attempt be made to initiate the 
procedure at the beginning of the project year. 



Groups' 
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No. of Meetings No. of Scales 



Direct Service Agencies 

North Tonawanda, Youth Bureau 

Alternative Learning Center 

Project CARE 

Kenan Center 

Center for Young Parents 

Lewiston Recreation Commission 

Chijd Maltreatment Project 

Green Circle 

Big Brother /Big Sister 



5 


13 


5 


6 


6 


•6 


~6 


7 


5 


8 


4 


5 


4 


8 


2 




4 


7 



60 



Administrative Units 

North Tonawanda Youth Board 
Niagara County Youth Bureau 
Evaluation Committee 
Program Committee < 
Project CARE 



J 



4 
6 
4 
4 

see above 
59 



7 
16 
4 
5 
3 



35 



95 



Figure 2. Procedure Summary 



RESULTS AND CONCLUSIONS 

This section presents the results and conclusions for the current year's involvement. 
Part I of the section presents the results and conclusions of the pilot evaluation. Following 
an overview summary, (figure 3, page 1* ), data for each participating group are presented 
separately. These include the final evaluation planning guides with rating and a summary 
sheet. Each Individual group'sheet contains a review score for each scale, preview scores and 
a change score (in the orie case where this was appropriate) and two grand review scores. 

Part 1 1 of the section presents the results and conclusions for the evaluation assessment 

(Reactions). 

♦ 

Part I. Pilot Evaluation Results and Conclusions / 

Wheri interpreting any goal attainment summary score (i.e. Grand Review), it is extremely 
important to remember that a score of zero (or 50 using the Kiresul^gherman formula) is an 
acceptable, even good, score, since the expected level is that level which is most likely to occur 
and which has been mutually accepted as being realistic. 

Examination of the overview summary and the individual group summary and sheets which 
follow indicate that all participating groups received scores at or above the expected level re- 
gardless of the method used to obtain them. These results demonstrate each groups overall 
compliance with its objectives. 
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Goal Attainment Score. 



1. 2 



Direct Service ' 
3 4 S 6 



7 8 



Administrative 
1 2 3 4 S 



BUS 61.67 



-2 



+1 



+2- 



53.42 



56.53 



60.42 



60.84 



67.50 68.69 



54.20 



54.56 



65.20 



70.35 



72.33 



Figure 3. Overview summary for eight direct service groups and five administrative 
groups. 
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North Tonawanda Youth Bureau - Direct Service 
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NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

Unit/Committee/Agency NORTH TONAWANDA YDUTH BUREAU ' Date of Mutual Acceptance_2ZZ4£aL 



FINAL 


Function- Youth Center 

Reduction in delinquent 
behavior CVC 

werght ■ 5 ^ 


y ■ 

Function- Youth Center 
Self initiated participation 

weight V4 


Function- Youth Center 
Confidence: 

Cjnnifi rant reaufifits for did 
weight • 4 


Function- Youth Center 

Attendance 
weight - & 


Function- 

* 

weight ■ 


Much less „ 
than the " 

results 

• 


more than (Ki% 


(ess than 


less than ' 
1o% ^10% 


« 

less than 85% 


* 

• 


Moderately 
less than the 
expected 
results 


* 

t ° 

O0-O0«> 


• * V 

5-8 5-8 


t 10-14% 10-14% 

1 


t 85-94% 




• 

Expected 

Results o 


45-55% CVC 
Tuesday than Wednesday 
on the average, between 
the hours of* 5 & 10, 
in census tracts 231 & 
232 


9-12 9-12 
different youth 
per month 


15-17% 15-17% 
different youth making 
significant requests per 
month 


95-105% of the 
October attendance 




Moderately 
more than the 

f> v nPPt Pfi ( 1 } 

results 


25-44% 


13-18 13-18 


18-20% 18-20% 

^ — . — — - — ■ ~ ■ 


106 110% 




Much more 

than the (2> 

expccicu 

results 


less' than 25% 


more than 
tis f l8 


more than . 
20% 20% \ 


more than 111% 


1 s 


Date(s) of 


10/1 11/1 t0/1 11/1 _ None 




Preview 

Date(s) .of 
Review 


December 1, 1978 


10/30 11/30 


■ t 

10/30 11/30 


11/30 





Clarification/ 
Definition 



2«i 



ERIC 



*CVC crimes,violations, 
complaints. 

Data collected weekly 
week of 9/18-11/*? 
Any exceptional day 
will be eliminated i.e. 
holidays, jnctement 
weathfer. XT/XW 



volunteering for and/or 
doing a responsible act. 
e.g. working in kitchen, 
participating in tourn- 
aments. 



Records (1) all requests 
noted for a month period. 
(2) Requests rated by a 
team as being significant. 
(3H£of different youth 
making significant requests 
determined. 
(4) % - J3 

total of individuals attending 
at least once during the month 



S^of different youth 

baseline established 
from October data 
(10/30) 
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Unit/Committee/Agency r NORTH TONAWANOA YOUTH BUREAU 

*" (direct service function) 



Date of Mutual Acceptance 9/14/78 



FINAL 



Much less 
than the 
expected 
results 



(2) 



Moderatejy 
less than the 
expected . -vw 

results 



Expected 
Results 



Moderately 
more than the 
expected _ (1) 
results 



Much more 
than the, 
expectejiL 
results Cr^ 





(2) 



Funct 



ietf(* 



Drop* 
Pfogn 



dropout 
-am 



Contracted 
weight m 3 



less than 75% 



75-87% 



^88-92% of reported 
youth contacted 



93-97% 



more than 98% 



Function* Dropout ' 
Program 

s 

Serviced 
we*ght ■ 4 ; 



less Xhan 18% 



*18-24% 



25-35%-% of possible 
youth serviced. 



3645% 



more than 45% 



Function Hire-A- Youth 
, Program 



Requests 

vweioht ■ ] 3 



less, than 

•15 # 15 t# 15 



* 

*1 5-23 * 15-23 15-23 



24-27 24 27 24-27 
employer requests 



Function-Hire-A'Youth 
Program 

Service 

weight m 3 



lea than 

-90% 90% 90% 



28-35 28-35 28-35 




more than 
38% 38% 



36% 



90-24% 90-24% 90-24% 



95-98% t 9&-98% 95-98% 
of appropriate requests 
filled. 



"Wi00% 99-100% Wl 00% 



F unctlon-Mro- A-Youth 
Program 

Employer satisfaction 
«vetght • 2 ' 



less than 61% 



61-70% 



71-80% satisfied 
employers 



81-90% 



fmore than 90% 



Date(s) of 
Preview 

Date(s) of 
Review 



Clarification/ 
Definition 



.none 



none 



9/1 



12/1 



12/1 



10/1 11/1 



9/30 10/30 11/30 



_QQflfi_ 



9/30 , 10/30 11/30 



PflPB 



12/1 



9~> 



ERIC 



review date includes 
all reports received up 
to 2 weeks prior to 
review date. 
Reported youth-those 
referred by schools, 
governmental units, or 
other agendas. 



serviced ~ 

1. back in school 

2. in GED program 

3. obtained employment 

4. in military 

5. referral to appropriate 
agencies. 

♦possible is contacts plus 
walk-ins. (walk in includes 
parental referral) 

^ 



monthly 

note all requests 



monthly 

1. note of appropriate 
requests 

2. determine of appro- 
priate requests filled 

3. determine % 2/1 



criteria * % of 
respondents who 
respond to question 
DVould you use this 
service again" 
Evaluation period 
9/1-11/30 
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NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

Date of Mutual Acceptance_J2£Z£!fiL 



Urm/Committee/Agency NQ^TH TON AW AND A Y QUTH fflJ/tf-W 

(direct service function) ' 



FINAL 


Function- Temporary 
Homes for Displaced 
Youth Program 

Host Families ^ 

weight • 4 


FunctionTemporBry 
Homes for Displaced 
Youth Program 

Initial Ptaeament 
weight * 5 


Function- Temporary 
Homes fo> Displaced 
Youth Program 

Permanent Placement ' 
weight • 5 * 


Function- Temporary 
Homes for Displaced 
Youth Program 

Transfer 
weight • 3 


Function * 
weight ^s^^T 


Much— 4ess 1 
than the" 
expected lz ' 
results 


* 

|p« fKan 7 
IC LI MJ* 1 * 


*tess than 70% 


*tess than 80% / 


^*lessthsff65% 




Moderately 
less than the 
expected M) 
resets 


J 

7-8 


70-79% 

\ 


1 80-89% 


65-80% 


• 


Expected 

(Pesults ^ ^ 0 

/ 


9-11 host families 
available 


80-90% - % of serviceable 
youth placed with host 
family within 24 hrs. 


no more than 5 days shall 
elapse before arrangements 
for permanent placement 
h$We been initiated for 
9&95% of placed youth. 


81-87% -%of placed 
runaways removed from 
host family within 5 
days. 

• 




Moderately 
more than the 
expected m 
results 


^12-14 


tftl 4) AAA/ 

• 


OK-infM. 
SfSr lUtTvO 


tnp-95% 




Much more 

than the 12) 

expected 

results 


more than 1 4 






more than 95% 


• 










Date(s) of 




1/1 


1/1 


1/1 - 1 




Preview 

Date(s) of 
Review 


none . 

12/1 

» 


12/1 


i2/r 


12/1 


* 


Clarification/ 
Definition 

♦ 




each transfer based on 
a request for placement 
change is counted as 
one. 




each transfer is counted 
% as one. e.g.. youth 
transferred 3 times in 
15 consecutive days is 
counted as 3. 






10 

i L 


11 


12 


13 > 
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NORTH TONAWANDA YOUTH BUREAU 



Review Uevel 



Weight ' 



Review Score 



> '1 

i 

+ 2 • • 
+ 2 

- 1 
+ 2 

- 1 
0 

- 1 

- 1 

- 1 
2 

+ 1 
0 
+ 1 

+ 2 

+ 1 

+ 1 

- 1 
+ > 



+ 5 



Review Score = 5 
G.A.S. = 51.67 
V.I. = 0.11 



+ 4»tr 
+ 5 
+ 3 
+ 4 

+ 3 = 3 

+ 3=-3)-12/3 

+ 3=V 

' + 3 - 3v 
+ 3-0>6/3 
+ 3 = 3 / a 

+ 2 

+ 4 

+ 5 

+ 5 

+ 3 



+ 2 

- 5 
• 0 

- 4 

+ 2 

+ 4 

+ 4 

+ 5 

- 5 
+ 3 




0 

+1' 
+2 



\ 



9 



i • 



Alternative Learning Center - Direct Service 



\ 



A 



>' 



V 



ERIC 



e>7 



JnO Reseafth # 

NIAGARA COUfiJTV COMPREHENSIVE PLANNING EVALUATION PROJECT * ' V 

OCTOBER 19, 1979 



• Unit/Comrnittee/Agen^ ALTERNATIVE LEAfi^&WR (N TON &H.SJ 



Date of Mutual Acceptance, 



4 r 

FINAL 




Function'/nw/ipverf 1 
instructional Climate ' 


F uric t i OQ^fieduced ■ 
Misberityw 
Ntfrnber of out of 

■ ft- ^flfriilMII 111*1111- 

scfHwf suspensions. 

Wrtfet. # 4 . . 


Function- improved 
Student Attitude 

t 

weioht * , 3 


Function- Public 

Relations 

Complaints 

weight " 2 


Function- Reduced 
Misbehavior 

Referrals to A L& 

4 " 


Much less 
than the., 

results . 


* 

♦ 

less thatUJO ' ^ 


greater than % 

* 


less than 75% 


* 

greater than 6 


greater than 35 


Moderately 
less than the 
expected M ' 
results 


2.00 Z49 


* * . 

3J-36 


,75-84* 


6 ' 


M 

31 36 


' Expected N 
Results o 


2.50-2.99* 
averAge-score on 
questionnaire 

t s 


5— -V* 

25 - 30 out of school^ 
suspensions 


• 

85 95% indicated the 
. ALC experience affected 
tfteir cdnduct positively. 


5 complaints'" 


^20 - 30 teacher referrals 
to ALC 

* 


Moderately . 
more than the 
expected [ x) 
results 


• \ * 9' 

'13.00*350 


^19-24 \ 

1 * ' 

• ^ ; 


i 

i 

^ greater ^than 95% 


4 

* 


% 

14 19 

0 


Much more 

than the • \2) 

expected 

results • \ 


« greater than 3.50 ' ' . - 

. / 


less than 19 

1 1 : 1 


r 


^less than 4 


less than 14 $ 



Dgte(s) of 
Review 

Date(s) of 
Review 



Clarification/ 
Definition s~ 



ERIC 



28 



•» ■ 

December tO, I978 1 


December 18,1978* 


December 18, 1978 


December 18, 1978 


December 18, 1978 


w Faculty questionnaire to 

— . be distributed on 

\ Dec 7. (1,2,3,4 scale) 

* Average will be taken. 
• 

* 

• 

1 • 


. « :— ' 

From Oct 2 to Dfc 15. ^ 
* (suspensions other^han 
for truancy) 

* * 

* 

2 > . 


' ALC monitor will 
interview each student. 
From Oct 2- to Dec. 16 

. \ 

3 


Unsolicited parent 
complaints concerning 
ALC from Oct 2 to 
Dec. 15. 

4 


From Oct. 2 to 
Dec. 15. 



.# • • M • # • • • # JnD Resea«# « 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 
Unit/Committtc/Ajcn n ALTERNAT IVE LEARNING CENTER tN.TQNS.HS) ' Dat e of Mutual Acceptan ce OCTOBER 19, 19>8 



FINAL 



Much less 
-than the 
expected 
results 

Moderately 
less than the 
expected 
result^ 



(-2) 



•Ml 



Expected 
Results 



Moderately 
more than the 
expected 
results 



{1! 



Much more 
than the 
expected 
results * 



Function- Reduction 
Misbehavior^. 

Incidence of repeaters 

weight ■ 5 




greater than 81% 



71-81% 



Function* 



.r 



68 • 70% repeaters 



54-64% 



less than 54% 




Date(s) of 
Preview 

Date(s) of 
Review 



Clarification/ 
Definition 



December 18, 1978 



ERIC 



3<> 



Base&on last year's 
^fiQ^mmore class - this 
year's Juniors. 
From Oct 2 to Dec 15 



6 



Function- \ 



Function- 



Function- 



31 



5 
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ALTER NATIVE LEARNING CENTER 



Seals No. 



Review Level 



Weight 



Review Seem 



1 

2 
3 
4 
5 
6 



+ 1 

$f i 
+ 1 

+ 2 
0 
+ 2 



+ 3 

+ 4 

+ 3 

+ 2 

+ 5 

+ 5 



+ 3 
+ 4 
+ 3 
+ 4 
0 

+ 10 
+24 



Review Score = 24 
G.A.S. = 66.69 
V.I. = 1.17 



-2 
•1 
0 
+1 
+2 



32 



ERIC 



Kenan Center - Direct Service 



Unit/Committee/Agency 



* JnD Rssodrch 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

KENAN CENTER l J- t Date of Mutual Acceptance — 11/8/1978 



FINAL 


Function* Recreation 
Field trip program 

weight ■ A 


Function- Recreation 
Field trip program 

weight m 4 


Function- Recreation 
Skating (handicapped) 

weight • 2 


Function - Recreation 
Drop-in center 

***** " 5 


Function- Recreation 
Free Skating 

weight - 5 


Much less 
than the 
exoected 
results 


tftss than 500 


0 


70 - 79% 


less than 279% 


less than 170 


Moderately 

less than the (-1 } 

expected 

results 


500 - 629 

**• 


1 


80-89% 

\ 


200-279% 


170-199 


m Expected 
Results 


630-650 
participants 


2 

new schools 


90 - 95% 
participation 


t 280 • 320% 
increase in participation 


200-230 
participants 


Moderately 
more than the 
expected 1 1 ' 
results 


651 - 662 


t 3 


tge- 100% 


321 400% 


231 -250 


Much more 
.than the 

expected * ' 
results 


more than 662 


— ■ ; 1 

more than 3 




Tg|pfe than 400%—^*^^ 


^more than 250 


Date(s) of 




* 


Preview 

Date(s) of 
Review 

Clarification/ 
Definition 

34 


December 20 


December 20 


December 20 


December 20 ( December 20 










Total number of 
student participants 
from October 1 thru 
December 20. 

1 


Number of new schools 
which participate 

t 

2 


% of total enrollment 
who participate 

3 


Increase from 1st 
Thursday in October thru 
1st Thursday in December 

4 


Enrollment 3rd' week 
in December 

5 



>tCn 



Unit/Committee/Agency 



NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

KENAN CENTER ■ Date of Mutual Acceptance 



JnD Research 

11/8/1978 



* 

FINAL 


Function-A/T 

Appreciation 

Art exhibition 


Functiotv Art . . 
Appreciation 

Art exhibition 

weight ■ 3 


Function- * ^ 

weight » 


Function- 
weight w 


• 

• Function- 
weight 


Much less 
than the 
expected 
results 


200-219 

•i 


less than 5% 








Moderately 
less than the { , , 
' expected 
results 


220-239 


5 14% 




• 




* 

Expected . 
Results / 

(— 


1 240- 260 
attending art exhibition 


15-25% 
new attendees 




\ 

f 




Moderately 
more than the 
expected 1 
results 


261 - 280 


26 - 38% 


* 

4 

4 


• 

4* ./V ■ ._ 


- 

* 

■ 


Much more 
than the 

expected ( ' 
results 


281 • 300 


^more than 37% 


t 


— a 




Date(s) of 








Preview 

Date(s) of 
Review 

• 

UiaNTFcaiion/ 
Definition 

3o 


December 1 


December 20 








*> 








Total number attending 
exhibition from Oct 
20 to Nov 27 

6 


% of new attendees to art 
exhibition calculated for 
5 d&Y* starting December 
1 

« 

7 






37 

• 



-27- 

r 

/ KENAN CENTER 



Scale No. 




Review Level 


111 • ■ M. 

Weight 


Review score 


1 




- 1 


+ 4 


4 

A 

• ** 


2 




+ 1 


+ 4 


+ 4 


3 




+ 1 


+ 2 


+ 2 


4 




0 


+ 5 




5 




+ .2 


+ 5 


+10 


6 




0 


+ 3 


0 


7 




+ 2 


+ 3 


+ 6 


• 

t 








+18 




Review Score = 18 

G.A.S = 6054 

V.I. = 0.72 7 



0 

+1 a_ 

+2 



s 





Center for Young Parents - Direct Service 



r 



JnD 



rch 



NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

..<"**.. 

n-twr* — i^/AgT^y ^ CENTEk FOR YOUNG PARENTS " Date of Mutual-Acceptance 11/10/78 



FINAL 



\Functlon- Group 
\ Counseling 



weight ■ 5 



Function- Effectiveness 
of Group Counseling 



wight 



*&unction- Individual 
. Counseling 



weight 



Function- Effectiveness 
of Individual Counseling 



wfght 



Function- Counseling 
V(sits 



Much less 
than the 
expected 
results 



(-2) 



ft 



Oar 
morfc than 5 



0*26% 



less than 7 
more than 20 



25% -49% 



one or less 



ntne or owe 



Moderately 
tess than the 
expected 
results - 



1-2-3 



26% -50% 



7-9 



50% -64% 



2-3 



Expected 
Results 



^4 discrete groups 
per week far months 
Sept, Oct. and Nov, 



written exam administered 
in a pre-post fashion with 
the average improvement 
score being 50% - 60% 



average per week attend- 
ance of 10 - IS students 
as scheduled for months 
Sept, Oct. endjNov. 



on the average, students 
will attend 68% -75% 
of scheduled se&ipns over a 
3 month period 



*on the average 4 - 6 
' visits per week during 
Sept. Oct and Nov. * 



Moderately 
more than the 
exjiected ' <n 
results 



61% - 75% 



ti6-20 



76% * 80% 



7-8 




Much more 
than the 
expected 
results 



.121 



76% - 100% 



more than 80% 



Date(s) of 
Preview 

Date(s) of 
Review 



Clarification/ 
Definition 



ERLC 



4«:» 



I ■ 

December 8, 1978 


0 

December 8 V 1978 


December 8, 1978 


December 8, 1978 


December 8 V 1978 








Possible 6th group will* 
be hlgtyy specialized in 
scope and will (teal with 
adoption issues. 

i * j- 


For December 1978 no 
testing wFM be done but 
a testing instrument 
will be completed* 

2 


* 

These are continuing 
cases. 

This covers students 
from Niagara County 
only. 

3 


Effectiveness ss a function 
of girls keeping scheduled 
counseling sessions, 
(school absenteeism not 
included) 

4 


Counseling visit* include 
visits to other schools; 
visits to homes for 
follow-up; 
visits to hospitals. 





JnD Reseerch 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

0 

» * 

Unit/Cdmmlttee/Agencv Q£NT£R FQR YOUNG PARENTS ; Date of Mutual Acceptance HflOp* _ 



FINAL 



Function* Counseling 
Visit Effectiveness 



weight ■ 



Function- Education 
Outreach 



weight 



Function- Education 
Outreacfi Effectiveness 



WPfQht 



1 



Function- 



Function - 



weight 



Much less 
than the 
expected 
fesults 



Small Indian Rei arvatlon School 



(-2) 



not admitted or more 
than 60 minutes /visit 



NONE 



less than 4 
None 



K 



Moderately 
i (ess than the 
expected 
results 



CD 



4 6 

1-2 



Expected 
Reeuits 



able to rfftlntain 
contact in a session 
for 10 -20 minutes/ 
visit for months of, 
Sept. Oct, and Nov. 



r visit & present at one 
school outside those 
normally worked with 
for the 3 momh period 



7 - 9 contacts for new 
referrals from a school 
visited over the course of 
1 year. 

estimate for 3 months 
(3 - 5) 



Moderately 
more than the 
expected m 
results 



20 • 45 minutes/visit 



tt - 15 
6-8 



Much more 
than the 
expected 
results 



<2) 



45 - 60 minutes/visit 



2 visits & presentations 



more than 15 
more than 8 



Date(s) of 
Preview \ 

Date(s) of 
Review 



Clarification/ 
Definition 



no preview 



December 8, 1978 


December 8. 1978 


December 8. 1978 







A 2 

ERIC 



% * 



Minimally 10 to 15 
minutes is needed to 
make an approbate 
assessment plan. 



6 



Due to the subject matter, 
the amount of time to 
deal with preliminaries 
for the presentation has 
been extensive. Presenta- 
tions can be made to stu- 
dents or groups of school 
j professionals. 



8 



Only contacts, not 
necessarily new admissions 
to Center. This includes 
resultant visits, hook-ups, 
other presentations, etc. 
There is considerable 
variability among schools 
in Niagara County to use 
; (con't) 



the Center and deal with 
Young Mother issues. , 
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CENTER FOR YOUNG PARENTS' 



Scale Ncr. 



Review Level 



Weight 



Review Score 



1 

2 

3 

4 

5 

6 

7 

8 



not evaluated 
+ 1 

not evaluated 
0 

not evaluated 
0 



1 



r 



Review Score = 4 
G.A.S. -= 53.42 
V.I. a 0.32 



+ 5 

+ 5 

+ 4 

+ 2 
+ 1 



■2 
-1 
0 
+1 
+2 



0 



+ 5 



0 
1 



+ 4 1 



r d 

ERLC 



V 



Lewiston Recreation Commission • Direct Service 



* 



• • • . • • • • JnD Reseal," 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

Unit/Committee/Agency ^/STON RECREATION COMMISSION Da t e . of Mutual Acceptance JM1MZL 



FINAL 


Function- Recreation 
complaints 


Function* Publicity 
brochure utilization 

weight ■ 2 


Function- Recreation 

retention rate 
5-o basketball 


Function- Recreation 

retention rate 
swimming 

weight ■ 5 


Function- Recreation 
enrollment 

weight - 4 


Much less 
than the 
expected 
results 


7-8 


4 

less than 30% 


* 

less than 60% 


less than 61% 

u 


# 

less tnan id 


Moderately 
less than the- 
expected M 1 
results 


5 6 


* 

30-44% 


, , . ^ 

• 

60-69% 


51 -.64% 


^5 - 17 


, Expected 
Results o 


3 - 4 complaints 


* 

45 - 55% of respondents 
utilizing brochure. 


*70 - 80% retention of 
participants 

• 


p 

65 - 75% retention of 
participants. 


« 

18 - 20 total + 
enrollment. 


Moderately 
r more than the 
expected n> 

rpcr t[t C 

1 Out 19 


'1-2 


56 - 70% 


81 - 94% 


7o - 82% 


Of OR 


^ 

Much more 

than the «2) 

expected 

resulis 


0 


more than 70% 

r 


more than 94% 


^more than 82% 


more thpn*7fc% 








D3te(s) of 
Review 


December 1 5 


December 1 5 


December 9 


December 9 


October 30 
4> — . . ^ 


Clarification/ 
Definition 

> 


winter programs 
conducted in a variety of 
v "host" locations. 

1 


160 phone calls 
% using brochure 

2 


5- 8 grade B. B. 
program. 

3 


primarily grades 3-6 

k 

4 


adult volley-ball 
program. 

-5 , 



LEWISTON RECREATION COMMISSION 



Review Level Weight Review Score 



to 



+ 1 + 4* - • +4 

+ 2 +2 +4 

0 +5 0 

+ 2 +5 +10 

-' 1 +4 - 4 



+14 



Review Score = 14 

t 

G.A.S. = 60.43 

V.I. = 0.70 -2 

-1 
0 

+1 

+2 



is 



, , Child Maltreatment Project - Direct Service 



re' 



- NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 
Unit/Committee/Agency OHM ^TREATMENT RENTER ■ NIAGARA FALLS 



m JnD Resear^ 

X 

Date of Mutual Acceptance 10/10/78 



FINAL 



Function- Visiting 
Friend Program 



Much less 
than the 
expected 
results 



(-21 



Moderately 
less than the 
expected 
results 



7orMss 



7 to 9.9 



Function- Visiting 
Friend Program 



none 



Function- Visiting 
Friend Program 



test than 3.5 



3.5 to 4.49 



Function- Public 

Awareness 



fewer than 7 



7to11 



Function- Public 
A 



wa^eness 



-tight ■ 4 



less than 12 



T 12.0-22.9 



Expected 
Results 



Moderately 
more than the 
expected (1) 
results 



the average number of 
volunteers for the 3 
months actively engaged 
in the program will be 
between 10 and 12.9 



S3 and I4.9 



*the majority of volunteers 
will work with 2 



4.6 * 5.49 average of 
volunteer hrs. per worker 
per week given to the 
program. 



5.5 to 8.49 



12 to 14 public 
presentations for the 
3 months Sept-Oct-Nov. 



23.0 - 27.9 the average 
of people in attend- 
ance per presentation. 



flB^Hfi 



28.0 34.9 



>Much more 
than the <2> 
expected 
rqfufts 

Dety(s) of 
Preview 

Date(s) of 
Review 



Clarification/ 
Definition 



T 1 5 or more 



more than 8.49 



more than 16 



more than 35 









1 1— ' 

J 




11/31/78 


11/31/78 


11/31/78 


• 


11/31/78 . 


11/31/78 



ERIC 



'Actively engaged' 
includes: 
training, 
supervision and 
phasing out. 



Statistics for months of 
Sept, Oct, and Nov 1978 
04 year) 

circular scale (no mote 
than ^3 are dellreable*. 
poiffi of deminishing 
return) 

Major it y«51% of actively 
2 engage^ volunteers. 



Includes work with • 
families (supervision) 
and training. 



Months of January thru 
Jura are heaviest 
months. September 
thru December are more 
moderate. 



• • • • • • • , • JnD Research 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PRO.ILCT 

Unit/eommittoc/Aocncy rt f" n MAI TREATMENT CENTER - NIAGARA FALLS Date of Mutual Arrpptan r-P 1 0/ 1 0/78 



0 

' FINAL 


Function- AiMfc 

Awareness 

weight - 2 ' 


Function- Ctone Team 
Meetings 

weight m 3 ; 


Function- Core team 
Diagnostic 
Services 

weight * 3 


Function- 

*m. - • ! 


Function- 
weight - 


Much less 
than the 
expected 
results 


less than 8 


* 

1 or less 


* 

incomplete ovoiuiiiivf i 
aftd or review 


I 
I 

J . • 

I 

! / . 

1/ ' 
>* 


; 4 


Moderately 
less than the 
expected M) 
results 


8-14 


2 meetings 


1 evaluation 






• 

Expected 

Results 0 


t number of requests for 
printed material over 
the 3 months Sept-Oct 
Nov - 15-18 requests 


3 core team meetings 
per quarter 


tat each core meeting 
there will be completed 
1 evaluation and 1 
review B ' 




• ' / 


Moderately 
more than the k 
expected <*' 
results 


19-21 


^4-5 meetings per 
quarter 


1 evaluation and 2 

reviews or 2 evaluations 




• 


Much more 
than the 
expected 
results 


more than 21 


6 meetings per' quarter 




i 






Date(s) of 






^ Preview 

Date(s) of 
Review 


11/30/78 


11/30/78 

J 


11/30/78 






Clarification/ 
Definition 

• 52 

4 

0 


/ 

* 

6 


the max number of 
core meetings possible 
per quarter as governed 
by funds i$ 6 meetings 
per quarter f 

7 


Functioning of any 
meeting of the core 
team. 

Note: this does NOT 
include core team In- 
service functions 

• 


* * 

S 


4 

t 



5.1 



Scale No. 

1 
2 
3 

« 

4 

5 
6 
7 
8 



■ 

CHILD MALTREATMENT CENTER 



Review Level 



+ 2 
0 

not evaluated 
+ 1 

- 1 

0 . 

* 

+ 1 



Weight 

+ 4 

+ 5 

t 4 
+ 4 

+ 2 ' 

+ 3 

+ 3 



Review Score 

* 

+ 8 
0 

+ 4 
- 4 

0 
+ 3 

0 



+11 



r 



Review Score =11 
G.A.S. = 56.5? 
V I. = 0.52 . 



-2 
-1 
0 
+1 
+2 



r 0 

ERIC ' 



54 



Big Brother/Big Sister - Direct Service 



55 



ERIC 



NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 



JnD Reseajph 



Unit/Committee/Agency «P BROTHERS/BIG ?ISTERS 



Date of Mutual Acceptance — 10/23/78 



FINAL 


Function- Recruitment 
of new volunteers 

weight ■ - 9 


Function- Recruitment 
of minority volunteers 

werqht - 2 


Function- New Assign- 
ments - matching vol- 
unteers with children 

(weight ■ 2 


function- Maintenance 
of present matches; 
volunteers with children 
for 1 year 

weight ■ 3 


Function- Service to 
Little Sisters 

« 

weigM • 1 


Much less 

than the . 

exDected 

results 


6 or fewer 


less than 8% 


6 or fewer 


24 or fewer 


t 

15 or fewer 


Moderately 
less than the 
expected M) 
results 


7 to 9 


• 

8- 10% 


7 to 9 


25-49 


16 to 17 


Expected 
^ Results o 

* 

Moderately * 
more than the 
expected n * 
results 


^10 - 15 new volunteers 
(total) during months 
Sept, Oct and Nov. 

16 to 18 


11 to 18% of new 
volunteers will be minority 
volunteers over 3 months 
Sept, Oct, and Nov. 

16 to 20% 


10 -15 new matches of 
volunteers with children 

• 

16-18 

♦ 


50 to 75 maintained 
matches 

• 76 to 80 


18 20 Little Sisters 
serviced by Dec. 1 

' ^1 -22 


Much more 

than the W 

results 


19 or more 


*over 20% 


^19 or more 


tat to 85 


23 or more 


D$te(s) of 
Preview 

Datt?(s} of 
Review 


Dec. 5, 1978 


Dec. 5, 1978 


Dec. 5. 1978 


< 

Dec. 5, 1978 


pec. 5, 1978 


Clarification/ 
Definition 

50 


months Sept, Oct, Nov. Due 
to change in Executive 
Director numbers maybe 
reduced (There maybe 1 
less staff member) 
This is strictly an Identif- 
ication of volunteers not 
placement. 


2 


new volunteers 
actually matched with 
children, not simply 
recruited and held In a 
volunteer "bank" Sept 
Oct- Nov usually high 
since prog, begins anew 
3 with each fall. 


numbers of matches 
held constant over 
the year, 

9 

4 


presently servicing 
17 -18 little sisters 

In R in Cieforc PrO- 

in Dig aNsiut* • »v 

gram. 

5 



JnD Reseafch 



NIAGARA,. COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 
^ntt/Cfrmm?mti/A3fincv BIG BROTHERS / BIG S/STBRS _ Date of Mutual Acceptance — IQ/Z3/78 



FINAL 



Much less 
than the 
expected 
results 



(-2J 



Moderately 
less than the 
expected MI 
results 



Expected 
Results 



Moderately 
more than the 
expected n > 
results 



Function- Rate of 
recidivism 



26-60% rate of recidivism 



21-50% rate of recidivism 



unction- Positive 
change in child's attituik 



under 50% 



.50-74% 



Function- 



Function- 



weight ■ 



no more than a 20% rate 
of recidivism 



10-19% 



^76-90% of children will 
exhibit a positive change 
in attitude. 



91-85% 



Function- 




Much more 
than the 
expected 
results 



(2) 



■under 10% 



96-100% 



Datefs) of 
Preview 

Date(s) of 
Review 



^Clarification/ 
Definition 



er|c 



December 5, 1978 


December 5, 1978 








During the 3 months of 
Sept Oct, and Nov, 
cumulative 

Recidivism means any 
further negative behavior 
resulting in contact with 
police or other social 

agency. 
6 < 


Posshive attitude change 
as indicated by improved 
behavior will be document 
ed through feedback from 
referral source (e.g., school 
social agency, or parent). 

7 


Scale 6 continued. 

Data from two sources: 

1. case workers 
records 

2. Police reports 
(quarterly and 
difficult to obtain) 

- 


J 


59 



42- 



BIG BROTHERS/BIG SISTERS 



Scale No. 



Review Level 



Weight 



Review Score 



1 
2 
3 

< 

4 

5 
6 
7 



I f 
« 



0 
+ 2 

+ 2 
+ 2 
+ 1 
+ 2 
0 



Review Score = 25 
G.A.S. = 67.50 
V.I. -1.14 



+ 5 
+ 2 
+ 2 
+ 3 
+ 1 
+ 5 
+ 4 



,-2 

- -1 

0 
+1 
+2 



0 
+ 4 
+ 4 
+ 6 
+ 1 
+ 10 

0 

25 



ERLC 




4* 



Project CARE • Direct Service 
Administrative 



ERLC 



* NIAGARA COUNTY COMPREHENSIVE PLANNING EVA&ATION PROJECT • JnlAesearch 

Unit/Committee/Agency- ■ PRQJECTCARE ; Date of Mutual Acceptan ce MSO* 

(direct service function) „. 

NIAGARA FALLS 



FINAL 



Much less 
than the 
expected 
results 



(-2) 



Moderately 
less than the 
"expected 
results 



(direct service function) , 

LQCKPORT MiftGARA FALLS 



Function- Participating 
Youth 



weioht 



leu than 



45 



45-54 



Function- Participating 
Youth 



wg.qnt " (4) 



ten than 



8 



I no* pnaT 



Function- Committed 
Youth 



_5_ 



tess than 36 



Expected 
Results 



* 0 



Moderately . 
more than the - 
'expected n > 
results 



Much more 
than the 
expected 
results / 



(2) 




active youth ^BB-SO 



61-65 



. more than, 



65 



active youth 



18-18 



more than 



'18' 



40-45 

committed youth 



46-50 



more than 50 



Function- Committed 
J Youth ' 



: is) 



Function- 



committed youth 




Oate(s) of 
Preview 

DateCs) of 
Review 



Clarification/ 
Definition 



3/30 6/30 9/30 12/30 



3/30 6/30 9/30 12/30 



12/30 



12/30 not included in 
GAS __ 



9 

ERIC 



Active ■ trained youth 
presently visiting (includes 
initial visit) or awaiting a 
match. Count taken 
during 3rd week of 
quarter. / 



( 



1a 



Active - trained youth 
presently visiting (includes 
initial visit) or awaiting a 
match. Count taken 
during 3rd week of 
quarter. d 

1b 



Committed - 6 months 
participation in<any 
match. Count taken 
during 3rd week of 
quarter. 



2a 



Committed - 6 months 
participation in any 
match. Count taken 
during 3rd week of 
quarter. 

Note: Service will not< 
have been provided for 
2b 6 months by review date 



\ 



t 



n{agara county comprehensive planning evaluation project 



JnD Research 



Unit/Committee/ Agency 



PROJECT CARE 



(direct service function) 



Date of Mutual Acceptance 10/27/78 



FINAL 


Function-/^/c/p*9 tr>n 
Seniors 

weight - 4 


Functlon&rticipating 
Seniors 

r 

weight - W 


F un ct ion • Committed 
Seniors 

wekiht - & 


Function- Committed 
Seniors 

weiaht • ^ 


F unction Interaction 
(number of visits) 

weiaht • ^ 


Much less 
than the 
expected 
results 


tots than 30 


lass than 3 


less than 25 


0 


under 

45% 45% 45% 45% 


Moderately 

less than the , , , 

expected 

results 


30-34 


>' 


^6-29 


0 


45-48% 45^8% 45-48% 45-489 

i * 


Expected 
Results % ^ 


active seniors ^35-40 


active seniors ^6-7 * 


30-34 seniors have been 
visited for at least 6 
months 


0 seniors have been 
visited for at least 6 
months 

/ 

i 


49-51 % 49-51 % 49-51 % 49-51 SK 
of randomly iampled youth 
have made or attempted to 
make at least 3 visits that 
month. 


Moderately 
more than the 

results 


r- 

41-45 


8-9 


35-40 


0 


52-55% 52-55% 52-55% 52-55$ 


Much more 
than the 

expected * ' 
results 1 


more than 45 


t 

" m&re than 9 


more than 40 


0 


more than 

ecru CCQ/ CCQ/ T Rf^CV 

DO to OOto OOto 'Dow 


Date(s) of 
Preview 

Date(s) of 
Review 

Clarification/ 
Definition 








3/30 6/30 9/30 12/30 


3/30 6/30 9/30 12^0 


12/30, 


12/30 not included in 


2/30 5/30 8/30 11/30 


1 — ; 








Active - presently being 
visited (includes initial 
visit) or awaiting a 
match. 

3a 


Active * presently being 
visited (includes initial 
visit) or awaiting a 
match. 

3b 


Committed ■ 6 months 
partidpatioh in any match 
Count taken during 3rd 
week of quarter. 

4a 


Committed - 6 months 
participation in any 
match. Count taken 
during 3rd week of 
quarter. Note: visitation 
began in July. 

4b -v B ' 


Sample: 

29% of youth randomly 
selected from active list. 
To to included in sample 
visitation must be possible, 
e.g., not possible if person 

is out of town or 
unmatched. Attempted 
visits: decision not to visit - 
ra*% bv senior. r 53 
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NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 



Unit/Committee/Agency- 



.enWECTGAffE 



FINAL 



{direct service function) t 
LOCKPORT NIAGARA f AILS 



Date of Mutual Acceptance — 1Q/27/7Q 



Function- Senior 
Sbtfsfm 



thfaction 



Interaction 



Function- Senior- 

Setfsfection 

Interaction 



Function* 



r 



Function- 



weight 




Functton- 



w«>ght » 



Much less * 
than the 
expected 
results 



less than 65% 



(ess than 



68% 



Moderately 
less than the 
expected 
results 



Expected 
Results 



Moderately 
more than the 
expected 
results 



Much more 
than the 
expected 
results 



Ml 



65-72% 



65-72% 



(1} 



73-77% satisfied 



*73-77% satisfied 



\ 



r 78-89% 



90-100% 



78-89% 



90-100% 




Date(s) of 
Review 



Clarification/ 
Definition 



9 

frit 



6 



Administered to ill 
seniors who have parti- 
cipated for at feast 3 
months. Crlteni - % of 
respondents who score 
2.6 or higher on Satis- 
faction- Rating Scale. 



Satisfaction flating Scale; 

1. I am enjoying my ex- 
perience in Project Care. 



Z If 



.could no 



longer come to vWt I 
would like another youth 
Q,to Weft me, 



3. I wouM recommend 
Project Care to other 
people. | 

4. I think that 



enjoying his/her experience 
in Project Care, 



Scale: 

4 * strongly agree 

3* agree 

2 -disagree 

1 - strongly disagree 
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PROJECT CARE: DIRECT SERVICE FUNCTION 



Review Level Weight Review Score 



0 



+ 4 = 0 
+ 4 = (/ 



7 >0/2 0 

- 1 . + 5 - 5 

. . not evaluated this year 0 
0 



0 



+ 4 - a 

>0/2 
+ 4 =* u 



+.5 



not evaluated this year 

+ 2 + 5 - +10 

+ 1 +4 = 4. ^"NgjJF 

M/2 ^ +2 

0 +, 4 «f f/ 



+ 2 



9 



Review Score = 2 

G.A.S. = 51.15 

V.I. =0.07 -2 



0— * 
+1 __ 

+2 



s 



Unit/Committee/Agency 



LOCKPORT & 



Jnlj Research 

NIAGARA COUNIY COMPREHENSIVE PLANNING EVALUATION PROJECT 

■ # . • 

Date of Mutual Acceptance 10/27/78 
LOCKPORT NIAGARA FALLS 



(administrative function) 
i NP LOCKPORT 



NIAGARA FALLS 



FINAL 


Function- Publicity 


Function- JSSLmm 

* 


Function- Xf^u 

Recruitment 


Function, Z°!L ow ' up ^ 
visits to seniors 


Function follow-up 
vtstts to seniors 




weight * 3 « ^ 


weight 4 


W9H#h1 - (4) 


weight ■ 4 


weight • (4) 


Much less 
than the 
expected 
. results 


less thlrS 

41 31 w 


*- 

less than 180 


• 

less than 115 


* m 

less than < 

75% 75% 75% 75% 


less than 

' 75% 75% 75% 75% 


Moderately 

l^s than the ( | . 

expected 

results 


41-50 31-40 


• 

. 180-199 

<• 


115- 129 


% . - 

7544% 7544% 75-84% 7544% 


7544% 7544% 7544% 7544% 


Expected 
Results 

• 


5160 * 41-50 
exposures 


200 240 

contacts 


130-150 

contacts 


<$ 

8540% 8540% 85-90% 85-90% ~ 
visited at toast once per Quarter 
by project coordinator 

«♦ 


8540% 8540% 8540% 8540% 
v 

visited at least onee per quart®' 
by project coordinator 


Moderately 
more than the 
expected ( 1 ' 
results 


61-70 ,,51-80 


* 

241 260 


*151 • 165 

>- 


9 1 -05% 91 -95% 91 45% t) % 45% 


* 

94 45% 91 45% 91 45% 91 45% 


Much more 
than the 

expected ' ' 
results 


more than + 
70 T 60 


'more than 260 


more than 165 


more than 
■95% 95% 95% . 95% 


more than 

95% 95* 95% *95% 


Date(s) of 




1/1 


1/1 






Preview 

Date(s) of 
Review k 


3rd and 4th quarters 
9/30 12/30 


12/30 


12/30 


3/30 8/30 9/30 12/30 


[ 3/30 6/30 9/30 "12/30 






* 




Clarification/ 
Definition 

Pj 


Exposure includes: 
^ of sites brocures are 
"distributed 

#r of media spots (radio 
or T.V.) 

|Ktrf articles published 
-iff of speaking engage- 
ments, (indudes presenta- 
tions to senior citizens) 


Number includes initial 
contact through lectures « 
referrals or walk-ins. 

2a 


Nubnber inciudes initial. 
, contact through lectures 
referrals or walk-ins. 

2b 


Seniors visited more than 
once in any given quarter 
only get counted once. 
For 1978 last quarter will 
be evaluated. 

3a 


Seniors visited more than 
once in any given quarter 
only get counted once, 
For 1978 last quarter will 
be evaluated. 

3b , 7n . 
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PROJECT CARE: ADMINISTRATIVE FUNCTION 



* 

Scale No. 


i — . — ~ — , — . ■ — i » ....... ' 

Review Level 

> ¥ 


I—La * 

Weight 




nevtew ocore 


r 


• 

+ 2 

+ .2 


+ 3 

+ 3'^ 


>12/2 


4, 

+ 6 


y 2a 


+ 2 


+ 4»8 N 


>12/2 


+ 6 


2b 


+ 1 


+ 4«4 / 






3a 


+ 1 


+ 4 = 4y 


>12/2 


+ 6 


% 


+ 2 


+ 4 = 8^ 




+18 



Review Score = 18 
G.A.S. = 72.33 

V.I. = 1.64 2 

-1 
0 

+1 



+2 5_ 



-7/ 



North Tonawanda Youth Board - Administrative 



• • . • • - • • • • JnD Researflfc 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

Unit/Committco/Aycncy NORTH TON AW AND A YOUTH BOARD Date of Mutual Acceptance 9/18/78_ 



(administrative) 



FJNAL 



Much less 
than the 
expected 
results 



(-2) 



Moderately 
less than the 
expected 
results 



Function- Bylaws 
Implementation 



weight * 4 



less than 5 



F unction- Program 
Committee 

Recommendation re: 
initial funding 
weight m 5 , 



5 out of 7 



6 out of 7 



F^unction-ftojram 
Committee 

Recommendation je : 
continued funding 
weight • q 



less than 38% 



35-45% 



Function Budget 

Committee 
Monitoring: monthly 
review of bureau funded 
buqbet line items. 
we<gnt 4, 



less than 8 



8 



Function- 



weight 



4 



Expected 
Results 



Moderately 
more than the 
expected 111 
results 



Much more 
than the 
expected 
results 



(2) 



6 tasks have been 
implemented or acted 
upon 



*7 out of 7 checklist 
tasks completed. 



46-55% of programs 
visited at least once 
during the year: 



56-70% 



more than 70% 



9-10 monthly budget 
reviews conducted. 



1*11-12 



ERiC 



Datets) of 
Preview 




1/1 


















Datefs) of 
Review 


12/78 


12/78 




12/78 


I ^ 


Clarification/ 
Definition 

t v/ 


7 tasks identified from 
BfYLAWS 

1 . otof meetings 

2. order of business 

3. election of officers 

4. submission of names 

5. presiding officer 

& standing committees 
7. Bylaw review (manditory 
for credit-without it 2 
^ is assumed) 


checklist 

1* notify public 

2 r review al! requests 

3t conduct Interviews. 

4. recommend acceptances. 

5. provide feedback 

6. ratify all refusals 

7. reconsider rejected 
programs, 

2 


visitation is for evaluation 
and does not include 
initial contact for 
funding. 

3 


> — 

\ 

monthly review checklist 

1. line by line analysis 

2. look for discrepancies. 

3. acceptance of recom- 
mendation for alleviating 
discrepancies. 

4. recofflnendatfon for 
transfer in line items if 
necessary. 

4 


* 

• 



• • • • • • ... • • #Jnb Research 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVA! UATION PMiUECT * 

Unit/Qommittee/Agency NQRTH TQtjfiWANDA YOUTH BOARD Date of Mutua , Acceptance 



(administrative} 



draft 



Much less 
than the 
expected 
results 



(-2) 



ft) 



Moderately 
less than the 
expected 
results 



Expected 
Results 



Moderately 
more than the 
expected m 
results 



Much more 
than the' 
expected 
results 



(2) 



Function- Publicity 
Committee 

Meeting notification * 

weight » 



lea than 90% 



,9099% 



100% prior notification 
in Tonawanda News of 
regular Youth Board 
meetings 



V 



Function- Publicity 
Committee 

Press releases 



number 



jN^umber 



number of press 

releases 



number 



.number 



Function- publicity 
Committee 

List of names 

*v€»QHt - 



number 



number 



Function- 



weight 



board member names pub- 
fished in Tonawanda News 

number of times per 

year. 



number 



Date(s) of 
Preview 

Date(s) of 
Review 



Clarification/ 
Definition 



number to be determined 



open for discussion 
number to be determined 



J^unction- 



weighi 



-53- 



NORTH TONAWANDA YOUTH BOARD 



TASKS FROM THE BYLAWS 



1. 
2. 

3. 
4. 

S. 
6. 
7. 



To have a minimum of 8 meetings with quorum. 

All quorumed meetings will follow the presa;iDed order of business (unless voted 
against by a majority at any particular meeting.) 

Two officers will be elected in October. 

Elected' officer's names will be submitted to the Mayor. 

Meetings will be conducted by the appropriate officers. 

Membership for six standing committees will be filled. 

The Bylaws will be reviewed in October. 



i 



PROGRAM COMMITTEE CHECKLIST 



1. 

2. 
3. 
4. 
5l 
6. 
7. 



Notify public of available funding (RFP) 

Review all incoming requests. 

Conduct interviews with all requestors. 

Recommend acceptances. 

ProvicJ* feedback to all refusals. 

Notify all refusals of appear of decision right. 

Reconsider rejected programs if funding becomes available. 



V ft 



BUDGET COMMITTEE CHECKLIST 



1. Line by line analysis. 

2. Look for descrepancies. ^ 

3. Acceptance of recommendation for alleviating discrepancies. 

4. Recommendation for transfer in line items if necessary. 



Prepared by 

JnO Research 
9/18/78 



77 



54 



NORTH TONAWANI?A YOUTH BOARD 



Scale No. 



Review Level 



Weight 



Review Score 



1 

2 
3 
4 
5 

Is 

7 



0 
0 



+ 4 
+ 5 



not evaluated this year 

+ 1 +4 

not finalized^ this year 

not finalized this year 

not finalized this year 



0 
0 

+ 4 



+ 4 



Review Score = 4 
G.A.S. = 54.20 
V.I. =0.31 



-2 
-1 
0 
+1 
+2 



7S' 



Niagara County Youth Bureau - Administrative 



• ' • • • • • ^ •jnD Research 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATld^PROJECT 

Unit/Committee/Agency NIAGARA GQUNTY YQVTH BUREAU ' v b^e of Mutual Acceptar^_5^8. 

(administrative function) s ^ 



FINAL 



Much less 
than the 
expected 
results 



(.21 



Moderately • 
less than the 
expected 
results 



(.1) 



Expected 
Results 



Moderately 
more than the 
expected (1) 
results 



Much more 
than the 
expected 
results 



(2) 



Function- Planning 

Evaluation 
Neetfs analysis/Geographic 
Dropouts 

weight ■ 6 



*W than 9 



9*14 



Function- Pfenning 

Evaluation 
Needs analysis/Geographic 
Youth crime 

weight m 5 



•lass than 9 



9-14 



Function- Planning 

Evaluation 
Needs analysis/ Sources 
Teen 'age pregnancy 

wvP^Qht • 5 . 



1-2 



FunctioR- Planning 

^Evaluation 
Needs analysis/Sources 
Youth Unemployment 

weight * 3 



Complete data for 
15-17 municipalities 



18-19 



'20 



Complete data for 
■ municipalities 



18-19 



"20 



data from 3 sources 
summed for county 



1-2 (of above 3) 
with breakdown 
remainder summed 



3 or mol sources 
with breakdown 



data from 2 sources 
in the county 



3-4 



more than 4 



Function - JHanning 

( Evaluation 
.Needs analysis/Sources 
BbHd abuse 



12 ^ v 



data from 3 sources 

Mn the .county 



45 



more than 5 



O) 



Date(s) of 
Preview 

D3te(s) of 
Review 



1/78 



12/78 



1/78 



12/78 



1/78 



12/78 



1/7R. 



12/78 



1/7B 



12/78 



Clanf 
Defi 



ication/ 
nition 



ERIC 



20 total municipalities 
1-2 towns 4 villages 
3 cities 1 reservation 
Data received from -school 
districts,! 11 maximum) 
Nov 1,76 thru Oct 30.77 
data used in planning 
June 79 



Li 



1977 data used for 
planning June I979 



2, 



Potential number of 
sources undetermined at 
this time* 

Data from Nov.Dec.77 
and the first 10 months 
of 78-hopefully. 



Potential number of 
sources undetermined at 
this time. 

Data from Nov.Dec.77 
and. the first 10 months 
of 78- hopefully. 



Potential number of 
sources undetermined at 
this time. 

Data from Nov. Dec. 77 
and the first 10 months 
of 78-hopefully. 



Si 



■ • . • ■•• • • • • • J„D ReseJh 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

Unit/Committee/A^ency NIAGARA COUNTY YOUTH SUHtAU — _ Date of Mutual Acceptance_^Z^^. 

.tfe (administrative function! 




* « 

rm/AL 


'Function- Planning 

^ Programming 
Availability of Programs 
Cu^ural 

yyeight » 2 


Function- Planning 

Programming 

Avai labi I i ty of Programs 
Recreational 

weiqhi " 2 


Function- Planning 

Programming 

AvaiiaDfiiiy ot rrograms 
Educational 

wetoht " 4 


Function- Planning 

Programming 
Availability of Proorams 
Youth Advocacy 

weight ■ 5 


Function- Planning 

Programme 
Availability of Programs 
Counseling 
weight - 4 


Much less * 
than the . ^ 
expected , t v 2 ' 
results 


*o o 


1 1 

! 

•o 0 


•o 0 


• 

4 

*o o 


i « 

♦o o 

— -* 


* 

•-Moderately 
'less than the 
expected M) 
results 


1 • t, 


■i 

1 1 


1 1 


1 ' 1 

<*" ■ 

T 


1 

r 1 


* 

Expected 

Results o 

1 /» 


2 rones served* 2 


2 ^zones served 2 
." 


2 zones served 2 


• 

2 zones served 2 


2 zones served 2 


Moderately 
more than the 
h /- expected { y 
results ' * 


3 % 3 


3 3 


* 

3 ' 3 


- 

3 3 


♦ 

3 '3 


Much more 

than the C2) 

expected 

results 


4 * 4 

4 




4 U 

V 


4 *4 


4 U 


DateU) Kjf 


«;ni^7fl S/31/78 5/31/78 


5/31/78 


Preview 

D3te(s) -of 
. Review 


11/31/78 


11/3t/78 


11/31/78 


11/31/78 


11/31/78 


Clarification/ 
Definition 


Fa* Scales ^11 

•Country wide program 
services at least 2 zones 
one of which has to 
be rural 

6 


5 total zones 

Purpose: to map prograhr 
before and after funding, 

<* 

7 . * . 


Procedure: * 
Preview-survey 0 of f I 
existing programs. 
Rev tew -survey j£of funded 
programs and qdd to<£ 
of existing programs. 

:- 6 '" V * . 


Note: there are 2 
1 scales in each area- 
one for preview and 
one for review. This 

9 


is redundant since 
preview and review 
are usually done on 
the same scale. 

10 * { 

■ • * 
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Untt/Committee/Agency NIAGARA COUNTY YQVW BM&U Date of Mutual Acceptance 9(7/78 

(administrative function) 



CI Hi A 1 

rlNAL 


— i 

Function- Wanning 

r\oqrammin$ 

Crisis Prevention 
wcicht ■ 5 


Function- Training 

Aoencies re monthly 
expense reports 

weight ■ 5 


Function- Training 

Agencies re proposal 
appOcations 

wvc^ht - 5 


Functibn- 

weight ■ 


Function- 
weight ■ 


Much less 

t nan ine . 

ekpected 

results 


# 

«o o 


7 n <7 


more than 40 


* 




Moderately 
less than, the 
expected M ' 
results 


1 " r ' 1 


7-9 7-9 79 


f 

33-40 

* 
f 


< 


• 


f ; n( 

Expected • 

ResuHs 0 


2 zones served 2 


10 10 10 

correctly comoteted 
reports 


• % 

28-32 follow-up 
contacts 


V 




\ Moderately 

m^tra than f VyA 

\ more inan ine 
expected n> 
results 


3 ; ,3 


11-12 11-12 1M2 


t22-27 


> 

■ 

1 


• 

i 


Much more 

than tne w 

expected 

results 




13 ' 13 '• 13 


» 

less than 22 






" Oate(s) of 


- 1 ■ — 

5/31/78 


nnno nOfie — — — 




Preview 

Date(s) of 
Review 


11/31/78 


■ UMU) — — — 

9/30 / 10/31 11/30 


August 1, 1978 




m 


Clarification/ 
Definition 


Ji 

see previous scates 
8-10 

* 

• f 
11 


monthly review 
criteria-correct infor- 
mation in the right 
places. 

maximum 55 13 reports 
12 


13 


1 


* 

* 



a 
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NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

, • . " NIAG ARA COUNTY YOUTH BUREAU DatL . 0 f Mutual Acceptance — 

Ui ni/Committee/ Agency ntnwnn — - 

(administrative function) 



FINAL 



Much less 
than the 
expected 
results 



(-2) 



Moderately 
less than the 
expected M ' 
* results 



Expected 
Results 



Moderately 
more than the 

expected ni 
results 



Function- Publicity 

Articles published 
external ty 

ight - 4 



vvei 



»0 <2 <4 <7 



Much more 
than the 
expected 
results 



(25 



Date(s) of 
Preview 

Date(s) of 
Review 



Clarification/ 
Definition 



So 
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1 2-4 4-6 7-10 



2-4 5-7 8-10 11-13 
articles published 



Function- Publicity 

Participation Joy outside 
sources 



*<15 <15 05 Ob 



16-26 16-26 15-26 16-26 



Function- Publicity 

Participation by outside 
sources (conl) 

weicM ■ 5 . 



(60 



'60-104 



Function- Publicity 

Formal staff 
presentations 

weight »' " 



•1 1 



2-3 2-3 0 1 



5-6 8-10 11-13 14-16 



>6 >10 T >13 t;i6 



27-33 27-ft 27-33 27-33 '. 105-132 



outside sources 



outside sources 



34-45 34-45 34-45 34-45 133-180 



>45 . >45 >45 >45 



y 180 



4-5 4-5 1 2-3 
presentations 



6-7 87 2 • 4-5 



)7 )7 ^2 >5 



Function- Publicity 

Formal staff 
presentations (con t) 

weight ■ 3 



less than 3 



3-7 



8,14 

presentations 



15-21 ' 



r )21 



_12L 



3/78 6/78 9/78 1?/2B 



3/78 8/78 9/7$ 12/78 




12/78 



3/31 6/30 9/30 12/31 



articles published 
externally but origin- 
ated by or written 
with staff. 



14 



quarterly review, 
outside sources having 
articles printed in the 
NEWSLETTER ' 
"Horizons" 



year end summary 




15 



quarterly review * 
prearranged public 
presentations relative 
to general bureau 
functions (not training 
or counseling) 



year end summary 
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NIA^RA COUNTY YOUTH BUREAU 



Preview Level 



• ■ r ■ * 



Preview Score 



Review Level 



Weight 



Review Score 



2- 

- 2 
2 
2 

- 2 
2 

2 - 

- 2* . * ' 
, 2 

- 2 
2 

not evaluated 
none 

- 2 
2 



10 
10 
10 
6 
6 
4 
. 4 
8 
10 
8 
10 



9 



6 



110 



+ 2 

+ 2 

- 1 

- 1 

- 1 

- 1 
+ 2 
+ 2 
+ 2. 
+ 2 
+ 2 

+ 1 

+ 2 

- .1 
+ 2 



+ 5 

+ 5 

+ 6 

+ 3 

+ 3 

+ 2 

+ 2 

+ 4 

* 5 

+ 4 

+ 5 

+ 5 

+ 4 

+ 5 

+ 3 



4 



i 



Change score - -1 1t£b + 49 (no. 13 eliminated fronj calculation) 
= change of 1 59 points. 

Review Score a 54 

G.A.S. = 65.20 

V.l. = 0.90 2 I 

0 

+1 _.ju_: 



+ 10 
+ 10 

- 10 

- 3 
-3 

2 

+ 4 
+ 8 
+ 10 
+ 8 
+ 10 

+ 5 
+ 8 

- 5 
+ 6 



+54 



t 
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Unit/Comftiitte?/ Agency 



w w w w m 9 jnD Researi 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PRO.IFCT 

EVALUATION COMMITTEE ; . Dat e' ,f Mutual ArrpptanrP AUGU ST 24, .1 978 



(administrative function) 



\ 



Much less 
than the 
expected 
results 



Moderately 
less than the 
expected 
results 



Expected 
Results 




Function- Monitoring 
Site Visits 

weight « 3 



"less than 2 



T 4 site visits 



more than 7 



Function- Monitoring 
Report Review 



*1ess t^K 



6 



*tess than 2 



13*15 reports] 
reviewed 



Function; Monitoring 

Report Review 
Checklist 



Function- fles/flw 

Reporting Procedures/ 
Forms Development 



Tess than 10% 



10-19% 



4 items 
developed 



more than 7 



15-20% of 
procedures and 
forms developed 



more than 36% 



Function- 



we»ght - 



December 1, 1978 



December 1, 1978 



December 1, 1978 



December 1, 1978 



Clarification/ 
Definition 



56 reports possible. 
Reports are those 
monthly pr interim 
reports presently being 
submitted. 



To establish consistency 
amoung submitted 
reports. Checklist items 
will emerge from 
reviewing process (see 
scale 2} 



1st meeting determines 
// of forms and 
procedures needed. £ ' 
provides standard for 
%. 



EVALUATION COMMITTEE 



Review Level 



Weight 



1 V 1 



Review Score 



0 

+ 1 

+ 2 [ 
+ 2 



+ 3 

+ 2 

+ 4 

+ 5 



0 
+ 2 
+ 8 
+10 
+20 



Review Score = 20 
G.A.S.* 70.35 
V.I.- 1.43 



2_ 



-1 — 

0 

+1 _L 
+2 — 
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Program Committee - Administrative 



■ i. 



W o 



93 



esearch 



NIAGAR/V COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

Da^e of Mutual Acceptance 11/13/78 — r 



Uriit/Commlttee/Agency NIAGARA COUNTY YOUTH BOARD PROGRAM COMMITTEE 

(administrative function) 



FINAL 


Function- Meetings 

* 

Attendance 

weight - 4 


Function- Proposal 
Screwing 

Interviewing 

4 

weight - 4 


F unction - Proposal 
Screening 

Site Visits 

wpight.- 2 


« 

Function- Recommend- 
ations re: funding % 

Task Completion 

weight - ^ 


Function - Gpmmuntca-i 
tion 

wpiflht - 1 


Much less 
than the 

.-expected 

1 results 


less than 4 


• 

less than 75% 


less than T5% 


less than 5 


less than 95% * 


Moderately 

less than the {l) 

expected 

results 


f 4 - 6 


75 - 84% 

I 


* 

15-24% 


- 


96-99% 


Expected 
Results 

• 

t 


7 - 8 meetings with at 
least 3 people in attend- 
ance. / 


f 85 • 95% of 
applicants interviewed 


3^- 35% of 

feasibl#applicants visited 


5 

tasks completed 


^^communication drafted 
fpk 100% of applicants^ 
re: funding decisions 

>\ 


Moderately 
rHore, ften the 
exffeqted ( 1 1 
results * v 


9 


96 100% 


38-50% 






Much more 
/than the 

expected (2) 
results 


9 

greater than 9 




'greater than 50% 






Date(s) of 
Preview 

« . Qatefs) of 












11/13/78 ' 


^ 11/13/78 


'11/13/78 


11/13/78 


11/13/78 


Review 










f^farif !r*at!rtn/ 

Wto* 1 1 lUIUUI 1/ 

definition 

N 

94 


Minimum * 10 meetings 

I 


Proposals pre screened 
by Bureau for technical 
accuracy ami adherence 
to guidelines* 

^ 

2 


Feasibility 

pre screened by Bureau 
has site/facility 
existing program 

3 9 


Ttsk cnacklist - 1 Usiu 

1 . ravfew proposals 

2 . conduct Interviews 

3 . make allocations / iru 

4. tafect proposals to Da roc* 
ommfndfd for funding 

s . rocommehd selected 
proposals to Youth Board 

6. rank rejected proposals for 
oosslbla future fundlne 

7 . recommend ranking to Youth 
Board for consldaratlon by 

^ Rollover committee. 


The Bureau to forward 
communication to 
applicants 

95 
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NIAGARA COUNTY YOUTH BOARD PROGRAM COMMITTEE* 

r 



Scale No . 

1 . 
2 
3 
4 

5 



Review Level* 



- 1 
0 

+ 2 V 
+ 1 

0 



Review Score = 5 
G.A.S. - 54.56 
V.I. = 0.48 



We ight 

+ 4 
+ 4 

+ 2- 
+ 5 

+ 1 



■2 

1 

0 

+1 '—* 
+2 



Review Score 

4 

0 

+ 4 

+ 5 

0 * 



+ 5 



9*> 
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Part II. Evaluation Assessment (R eactions ) Results and Conclusions. 

Thirty-four participants responded to the evaluation questionnaire "Reactions". Of these 
22 had been present at 100% of their meetings (or all 4, 5, or 6 meetings); 8 had missed one 
meeting (3 out of 4, 4 out of 5, or 5 out of 6); 1 missed two meetings (4 out of 6),' and 3 had 
missed half their meetings (2 out of 4). , /• 

The results of the evaluation are presented in Figure 4, (pages 68 & 69) and are formated as follows. 
For each question, frequency and percentage of total response are presented for each response 
choice. 

Examination of Figure 4 indicates that the response to the evaluation was overwhelmingly 
positive. Thirty-three or 97% thought their participation in the process was usefuL. Of those, 
15 or 44% though\it was extremely useful and 18 or 53% thought it was of some use. Only 
1 person (3%) fourta it of little use. Interestingly, all 34 respondents (including the one neg- 
ative respondent above) felt the goal attainment scaling method was helpful. Most found it 
to be nonthreatening (91%), beneficial(91%), and facilitated communication and cooperation 
within the'ir staff (76%) . The majority indicated that use of the method helped clarify thinking 
about planning (79%), individual staff responsibilities (79%), identifying purpose or function (82%), 
and determining effectiveness (91 %) . Therefore, it is clear that the process aided the participants 
not only in assessing progFams, projects, and functions but also in various phases of management. 

Participants response to" the evaluation staff was also very positive. This would seem to indicate 
that JnD Research did it's job well. Results for the two items related to planning for next year's 
evaluation indicate that a majority of this year's participants would like to or feel the need to work 
with the evafuation team again next year. Varying degrees of involvement were specified. In 
general, approximately half would like the same amount of assistance or more; half less than this 
year. In addition, 19 pebple (56%) indicated that they would like help applying the goal attain- 
ment scaling concept to new and different situations. 

The comments elicited from the evaluation are presented in Appendix E. The 34 responses 

from Item 1 and Additional Comments have been summarized together and entitled General 

/ * 
Comments. The vast majority of these, remarks (24) are positive and are presented first, followed 

by the seven neutral and three negative remarks. 

Comments from Item 4 are presented separately. This section includes a list of the ways 
participants have used or expanded the goal attainment scale concept. 

Perusal of the total comment section indicates again that this year's development/pilot phase 
of the Niagara County Comprehensive. Planning Evaluation Project was extremely well received. 
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NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

REACTIONS 



N«34 



1 ? In general, participation in the evaluation project was 
f/% • « . 

ft 5/44 extremely useful 
18/ ®f somewhat useful 
1 ' 3 of little use 
~9i not useful * 



Comments 16/47% commented 
, 18/53% did not comment 



2. 



Please indicate your perception of the Goal Attainment Scaling Method by rating 
or phrase below: 

. (a) Use of the Goal Attainment Scalmg * 

Method / 44 4 S 

m£ f/% f/% f/% 

was helpful 

was non threatening 

was beneficial for our staff . . ... . . -W32 . 20/53 WL_ 

facilitated staff communication - . . . . 12/35 15/44 4/12 

and cooperation 

r .. 

(b) Use of the Goal Attainment Scaling 
Method helped to clarify my thinking 
about 

^ 

planning 124* * iSM -M| 

individual staff responsibilities * — 13J53 -SOl 

identifying committee or agency • • • • tS/SS MUL 

purpose/funetion ' 
determining committee or agency ■ ■ ■ ■ — — - 

effectiveness fc 



each word 




- f/* 



1£_ 



no 
response 

f/% 

-0- 

-0- 

2# 

3/? 



-0- 



i 

3. 



In order to construct scales to evaluate next years program, we will need the following 
amount of assistance from the Evaluation Team: * 



f/% 



2/6 more than this year 

the same amount as this year 
1 2/35 somewhat less than this year 
5/15 considerably less than this year 
1/3 no response , 



\ 



4. I have utilized/expanded the Goal Attainment Scale concept in the following ways. 
23/68% responded to this _ [ , . ' 



. ' _L±!{32 



% did not respond 



Figure 4. Reactions Results 
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5. I would like help In applying the Goal Atfetn men t Scaling concept to new ancTdifferent situations. 

f/% '- V 

19/5SL Yes V 

• No 

2/6 norespoasB 

• V 

6. - Please indicate your perception of the JnD project staff by rating each word below: ^ 

The project staff was: - # d «^ ^ * ? 

.f/% -f/% f« w 

helpful S.. '. 1MU> MM .dL_ ^ 

competent > 11& 

accommodating 12/38 1SU Jk_ 

facilitative * 2JJS2 1L32 2£L_ Jt— 

ADDITIONAL COMMENTS 19/56% commented , ^ 

f 5/*4 « rift/ nof coSnent _ 

i — i ' 1 ; 

* ■ : * 4 

: * ^— — — : 

Agency . — . _ '■ 

Name (optional)- . , = 



Figure 4 continued. 



/ 



/ 
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Appendix A: Evaluation Planning Guide. 
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NIAGARA COUNTY COMPREHE 



• # • 

NSIVE PLANNING EVALUATION PROJECT 



* Unit/Committee/ Agency 



• JnD^esearch * ^ 
Date of Mutual Acceptance 



'J 


Function- 

' — 


Function- 

i , 
j 


Function- 

weight « 4 


Function- 

weight • 


Function - 
weiaht - 


Much less 
than the 

expected IZI 
results 


— a : — 

m 


weight - | 

i 

1 

j 
1 
1 

1 


$ 

9 

• 


« 


* 


Moderately 

less than the (1) 

expected 

results 


* 


1 

. 1 

r % 

i 


• • 


• 

' — 


* 


Expected 
Results 




i 






• 


Moderately 
, more than the 
expected ( 1 5 
results 






• 






,Much more 
than the 

expected 11 
'results 


r 






1 


/ 


Date(s) of 








Preview 

Date(s) of 
Review 

Clarification/ 
Definition 

102 .' 


\ 


■ V 














i 


* 


t 

t 

$ 




* 

' ±W 
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Appendix B: Handout Distributed at Initial Agency 
Presentation. 
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JnD RESEARCH 

educational Research • Designs Evaluation - Statistic*) Analysis 

162 Red CVt* Drive ■ • 

* MII«miv*H#. N Y. 14221 

(7161 688 7396 



JUDITH WOLF, Ph.D. 
OAVID SVLVES. Ed.D. 



WHO: 



D>. Judith Wolf 
Dr. David Sylves 
Dr. Gordon Bianchi 
Dr. Warren jGleckei 



WHAT: \ 

To facilitate the pilot implementation of an evaluation process and design 
as part of the Niagara County Youth Bureau's comprehensive youth services 
planning commitments to the New York Division For Youth. 



WHEN: 



Now to December 31, 1978 



HOW: 



On the job training of selected personnel for the design of individualized 
.instruments for self evaluation of funded programs,. 



WHY: 



To assist in planning, proposal writing, program monitoring, and program 
evaluation. 



r 



if? 



f> 
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B-2 



ADMINISTRATIVE/PROGRAMS 



QIRECT SERVICES/ AGENCIES 



North Tonawanda Youth Board . 
Niagara County Youth Board 
Niagara County Youth Bureau 
'Niagara County Youth Bureau Rural Committee 
Niagara County Youth Bureau Evaluation Committee 
Niagara County Youth Bureau Program Committee 



North Tonawanda Youth Bureau 
North Tonawanda Alternative Learning Center 
Project CARE 
•Keenan Center 
Center for Young Parents 
Lewiston Recreation Commission 
Mid City Coordination Commission 
Child Maltreatment Project 
Green Circle - 
Big Brother/Big Sister • 



WHAT: 



WHEN: 



HOW: 



1. Design individualized pilot instrument 

2. Self evaluate pre/post 



f 



3-4 meetings with evaluation consultants 
I - 3 meetings prior to September 31 ? 
Last meeting at the end of November 



Utilization of Goal Attain 



™*4 



ling 



- construct appropriate individual objectives 

- select relevant Measures , 

- determine importance rankings 

- pre/post 

- feedback s 

s 



ERIC , f 



1% 



ORGANIZATION NAME J. ! . 

> 

ADDRESS _^ : ! 

PHONE NUMBER* I '. : 

a 

CONTACT PERSON - ' v . . - 

• «< 

POSSIBLE DATES FOR TRAINING . 1-= 



1 



COMPREHENSIVE PLANNING EVALUATION 

JnD' Research 



/ 



Area/ Agency 

Date J 

Time 



SESSION/MEETING SUMMARY 

* • 



\^ation 



to 



Meeting , Number 1 2 3 4 _ 
Leadai^t: : . 



Personnel in attendance: 



BECAUSE THE NAMES OF INDIVIDUALS . WERE .INCLUDED ON 
THE COMPLETED SESSION FORMS, THESE FORMS HAVE BEEN 
OMITTED AND A BLANK COPY SUBSTITUTED. 



Purpose: 



Accomplishments: 



Comments: 
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JnD RESEARCH 

NIAGARA COUNTY COMPREHENSIVE PLANNING EVALUATION PROJECT 

v 

• * t 

f 

i ** *■ * 

REACTIONS 



In general, participation In the evaluation project was 

extremely useful 

somewhat useful 

•Jllli of little use 
1 not useful 



Comments 




Please indicate your perception of the Goal Attainment Scaling Method by rating each wor^ 
or phrase below: 

(a) Use of the Goal Attainment Scaling jA a 

Method , ^afT &\ 6& 

was helpful - - . ^— ; — . 

was non threatening ■ 

was beneficial for our staff . • . ■ — — 

facilitated /staff communication . ■ ./ ■ — — 

and cooperation , 



\ 



(b) Use of the Goal Attainment Scaling 
Method helped to clarify my thinking 
about '* ■ 



planning 

individual staff responsibilities ■ « 
identifying committee or agency 

purpoja/fupction 
determining committee or agency 

effectiveness 



In order to construct scales to evaluate next years program, we will need the following 
amount of assistance from the Evaluation Team: 

more than this year 

the same amount as this year 

somewhat less than this year r 

considerably less than this year 



I have utilized/expandecHthe Goal Attainment Scale concept in the following ways: 



ndecHthe 

I— 



in 



OVER 



5. I would ltke.help in applying the Goal Attainment Scaling concept to new and different situatipns. 

» * 

■ 

Yes • v 

No * . . ' 




6. Please indicate your perception of the JnD Rrojectstaff by rating each word below: , ^ 

The project aaff was " . ' ' ' A> I S A 

helpful ■ 

competent ■ • ■ • j — — 

accommodating . . : — - 

facilitative . . . . ' . ; . . — - — — 



ADDITIONAL COMMENTS /. «■ : ■- — — y 



5? 



Agency _ ; — 

Name (optional) * 



. A 



4 



% 

I 

; 
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Appeadbc E: Comments 

1. General Comments 

« 

2. Item 4. 



A. ' Comments regarding utilization of the goal 

attainment scale concept. 

B. Comments regarding expansion of the goal 
attainment scale concept. 
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GENERAL COMMENTS 

(Ite/n 1; Additional Comments) 

■ • 

Positive Comments 

+- 

> ^ 

I found the process to be an excellent jneans of not only evaluation but of setting standards 
and procedures for a more comprehensive program. 

Give me ats director valuable information for staff evaluation and proposal writing. 

Extremely helpful. Needed at this time in outreach counseling. 

The need was there and clearly seen, but I don't think much would have happened if 
JnD hadn't been on board. 

The evaluation was useful to me in that it gave me an idea as to what some of the strong and 
weak points were in the program. 

I am sure this will be helpful in our own office program planning. 

I enjoyed working with Gordon Bianchi, and. found the whole evaluation process. interesting 
and beneficial. 

This was difficult but "a I so timely and also productive to our agency. 

Gave us atormat for organization of our program, clarified areas of importance. 

I have madewhat I feel is good use of their concept - it fits very nicely in MBO and 
compliments other management techniques. 

Since results were in our instance, surprising, my initial skepticism of counting heads 
was overcome. * * 

t 

My reluctancy toward any evaluation and then my own subjective judgement were 
' put to.rest. 

Another program is being developed to complement CARE - (YES Youth Engaged in 
Services). Goal Attainment Scaling would be very effective in evaluating this project. 

There is a degree to which I feel that the techniques of Goal Attainment Scaling could 
be learned by the Youth Board and accomplished by them. Your service would be 
helpful in this sort of training." The level at which we worked with this scale this year 
seems adequate for our needs. 

The Youth Board needs anotheV year of working with JnD in order to fully underftond 
Goal Attainment Scaling.and make certain that it becomes a part of the Bureaus nomnal 
operation. 

The first step was a learning experience, next attempt will be more beneficial. 
Still much potential" yet to be realized. 
Training for the entire Board would be beneficial next year. 



As we discussed - 1 feel it would be more benef icial for the entire board to participate in. 

~ it stimulated discussion around worker rules and tasks. 

Clarifying process for staff - should be done at each persons rate. 

Baing there to explain the prdgram I believe brought a better understanding.- 

It is our job to provide leadership in youth programs. This connpt »e judged through 
scales. However the scales facilitate compliance with administrative functions. . ^ 

' I am sure they 'will be, extremely useful as we get to use them in the future. . , 
Neutral Comments 

I feel that it will be more useful next year when we have the full year for planning. 
This year the short time period fpr evaluation made it difficult to evaluate any but the 
last quarter. 

I believe we're almost ready to work alone, but probobly still need guidance and direction. 

In. the begin ing I was thouroughly confused but now I feel that I have a better understanding. 

I was not assigned scales to complete but still have to develop scales for my project in 1979. 

Although the goal attainment method is a valid indicator, our procedure next year will 
not change significantly. 

I see this program as a monitoring system to insure we accomplish required tasks. I believe 
the same results could have been accomplished by some checklist which could have been 
prepared by the board with some work. No scales can possibly evaluate our effectiveness 
beyond our adherence to certain tasks and deadlines. 

There is a possibility of it making us do the work to fit the evaluation instead of the evaluation 
the work. 

Negative Comments 

ideas discussed were already generally under consideration. Our major problems are people 
problems in the community. They aren't very measurable by scales^ Scales are impersonal 
and used on community -would only turn off those, youth we need to reach. 

Some, things were useful, but I felt in general we wasted time that could have been uoed ^ 
for more important items within our board. 

Various Youth Board functions were not scaled andno meaningful comprehensive planning 
or evaluation methods were developed. Areas developed were sketchey and incomplete for 
various reasons. 



J 



. ITEM 4 . . » 

. . / 

# 

/ 

Utilization of the Goal Attainment Scale concept. 

To evaluate last years program; and to plan ahead giving more consideration to those 
areas we determined were important. 

Evaluation of role and realistic planning for job duties of workers. 
Preliminary analysis of committee effectiveness and board responsibilities. 
Use of concept in staff evaluations. 

By re-evaluating how statistics are kept in relation to this project. 
For use in 1979 program evaluation"'. 
Use for contract agencies in future. 
Opened my thinking to more objective ways to evaluate successes apd short comings. 
I hc.ve utilized the scales concept in my program! 
A refresher in required activities - a checklist. 
For use in program planning for 1979. 
Planning for development of my own project scales. 
I shall continue to monitor new attendees and try to see if they return. 

E xpansion of the Goal Attainment Scale concept. 

( 

Planning and follow-up were expanded due to use of scales. 
Expanded to individual programs (i.e., youth employment). 

Development of scales for each diract service component. Incorporating into total plan 
forFY1979. 

Begining to expand into other factors of my work. 

Planning own work load in others areas, (excluding youth board activities). 

Put all our funded agencies on scales. 

Development of a monthly scale for reporting purposes. 

Set up new reporting forms due to evaluation project. 

Planning to use Goal- Attainment Scaling in all programs. 

1 la 




